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SYSTEM AND METHOD FOR SCALING AND REPOSITIONING DRAWINGS 

TECHNICAL FIELD 

[01] The present invention relates to the electronic manipulation of text and drawing 
images. More specifically, the present invention relates to computer systems in which 
electronic documents containing text and drawing images may be edited and to novel 
processes for editing such documents. 

BACKGROUND OF THE INVENTION 

[02] Perhaps one of the most valuable contributions made by computers today lies in their 
ability to electronically create and manipulate documents. A task that previously 
required manual typewriters, correction tape, and carbon copies can now be 
accomplished in electronic format, with minimal wasted time and resources. 
Although discarded typewriter ribbons, carbon sheets, and paper rough drafts are now 
safely a thing of the past, modern innovations in word processing computers and 
systems continue to improve efficiency. 

[03] One such improvement is the ability to incorporate drawing images as part of an 
electronic text document, and is offered in one form or another by a variety of word 
processing programs, such as MICROSOFT WORD®. For example, Fig. 1 illustrates 
an onscreen page 101 of a typical word processing program, in which text 103 and 
drawings 105 may coexist. Typical word processing programs also permit users to 
create text using different typeface fonts and/or sizes. Accordingly, it is possible for a 
user to change text 103 to a larger font, shown in Fig. 2. Also shown in Fig. 2, 
however, is the fact that upon increasing the font size, there is no longer enough room 
on the page for the drawing images 105. The drawing images 105 are, therefore, 
moved to the next page in the electronic document, leaving a space 201 on the current 
page. This space 201, however, is often confusing to the user. If the user were to 
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enter data in space 201, it remains unclear as to where the data would appear, as it 
might be inserted into the document before, or after, the drawing images 105. 

[04] Additionally, in typical word processing programs, changing the font size does not 
change the size of a drawing image. The user who resized the text, for example, to 
make a document more readable with larger letters typically would also desire a 
corresponding enlargement to drawing images as well. With the typical word 
processing program, the user would have to undertake a second step of selecting and 
resizing each drawing image in the document. Accordingly, there is a need for an 
improved word processing system that can automatically resize drawing images in a 
document, responsive to a change in font size in the document. 

[05] This need extends to any device capable of editing or manipulating electronic text or 
drawings, such as personal data assistants (PDAs), portable computers, cellular 
telephones, etc. For example, the personal computer (PC) device shown in Fig. 4 may 
process electronic text and/or drawings, and may be a pen-based computing device. 
Fig. 5 depicts an example page 501 of a document that may be shown, for example, 
on the Fig. 4 device. Page 501 may include one or more lines 503, for example, to 
assist users in aligning handwritten text, and may also include one or more drawing 
images 507. The device permits users to redefine the line height for lines 503, and as 
discussed above with regard to changing font sizes, it is desirable for drawing images 
507 to be resized according to changes in line height. 

SUMMARY OF THE INVENTION 

[06] According to the present invention, a novel system and/or method is provided for 
resizing and/or repositioning one or more drawing images in a document responsive 
to a change in textual font or line height or line size of the document. 

[07] The electronic document may be separated logically into a number of horizontally- 
adjacent regions, each region having its own reference axis. Drawing images and text 
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may be distinguished from one another. A region in which the drawing is said to 
primarily exist may be identified, and the drawing may be anchored to the reference 
axis for that particular region. 

[08] A drawing itself may have one or more reference points for the anchoring process. 
The present invention further provides a method for determining such a reference 
point. 

[09] When a line height or font is changed, the drawings may first be resized in proportion 
to the change in line height. An offset from a drawing to the reference axis of the 
drawing's region may also be scaled, and the resized drawings may be repositioned in 
accordance with the scaled reference axis offset. 

[10] The system may determine whether the resized and/or repositioned drawings will fit 
in the allowed page width. If the drawings will not fit, then one or more of the 
drawings may be repositioned in order to avoid overlap, and the drawings may be 
resized to fit the allowed page width. 

[11] Further, the repositioned drawings may be partially displayed on a page, and may also 
provide indicators to inform the user that the repositioned drawing continues on 
another page. 

[12] Newly-added drawings may be compared with existing drawings, and may be 
combined as a single drawing for purposes of anchoring, resizing, and/or 
repositioning. 

[13] Additional features and aspects of the present invention are found in the following 
descriptions and the drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



[14] Figures 1-2 illustrate behavior in typical prior art word processing programs when 
font size is changed. 

[15] Figure 3 illustrates a schematic diagram of a computing device on which one or more 
embodiments of the present invention may be implemented. 

[16] Figure 4 illustrates a personal computer device on which one or more embodiments of 
the present invention may be implemented. 

[17] Figure 5 illustrates an example display area, such as on a pen-based computer device, 
on which one or more embodiments of the present invention may be implemented. 

[18] Figure 6 illustrates the display area shown in Fig. 3, with a resized line height. 

[19] Figure 7 illustrates an example of a document having logically-defined regions 
according to one embodiment of the present invention. 

[20] Figure 8 illustrates the display area shown in Fig. 5, with reference axes for the 
logically-defined regions. 

[21] Figure 9 illustrates an example drawing that may be modified using one or more 
embodiments of the present invention. 

[22] Figure 10 illustrates an example process in one embodiment of the present invention. 

[23] Figures 1 la-d illustrate a process, and example drawings manipulated by the process, 
according to one embodiment of the present invention. 

[24] Figure 12 illustrates two sequential pages in an electronic document according to one 
embodiment of the present invention. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

[25] The present invention may be more readily described with reference to FIGS. 3-12. 
Figure 3 illustrates a schematic diagram of a conventional general-purpose digital 
computing environment that can be used to implement various aspects of the present 
invention. A computer 300 may include one or more processing units 310, system 
memory 320 (RAM and/or ROM), system bus 330, basic input/output system 360 
(BIOS), hard disk drive 370, magnetic disk drive 380, optical disk drive 391, etc. It 
will be appreciated by those skilled in the art that other types of computer readable 
media that can store data that is accessible by a computer, such as magnetic cassettes, 
flash memory cards, digital video disks, Bernoulli cartridges, random access 
memories (RAMs), read only memories (ROMs), and the like, may also be used in the 
example operating environment. 

[26] Computer 300 may include a number of program modules, such as an operating 
system 395, one or more application programs 396, other program modules 397, and 
program data 398. A user can enter commands and information into the computer 300 
through input devices such as a keyboard 301 and pointing device 302. Other input 
devices (not shown) may include a microphone, joystick, game pad, satellite dish, 
scanner or the like. Computer 300 may also include one or more display monitors 
307, other types of display device, or other forms of output device, such as speakers 
and printers. For example, a pen digitizer 365 and accompanying pen or stylus 366 
may be provided in order to digitally capture freehand input. The digitizer 365 may 
be integrated in the monitor 307, or may exist as a separate device overlaying or 
otherwise appended to the monitor 307. 

[27] The computer 300 can operate in a networked environment using logical connections 
to one or more remote computers, such as a remote computer 309, and may operate as 
part of a local area network (LAN) 312 and/or wide area network (WAN) 313. 
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[28] Although the Figure 3 environment shows an exemplary environment, it will be 
understood that other computing environments may also be used. For example, one or 
more embodiments of the present invention may use an environment having fewer 
than all of the various aspects shown in Figure 3 and described above, and these 
aspects may appear in various combinations and sub-combinations that will be 
apparent to one of ordinary skill. 

[29] Figure 4 illustrates a device 401, such as a pen-based computing device, that can be 
used in accordance with various aspects of the present invention. Any or all of the 
features, subsystems, and functions in the system of Figure 3 can be included in the 
computer of Figure 4. Device 401 includes a large display surface 402, that is 
preferably a digitizing flat panel display, such as a liquid crystal display (LCD) 
screen, on which a plurality of windows 403 is displayed. Using stylus 404, a user can 
select, highlight, and write on the digitizing display 202. Examples of suitable 
digitizing flat panel displays include electromagnetic pen digitizers, such as the 
Mutoh or Wacom pen digitizers. Other types of pen digitizers, for example, optical 
digitizers, may also be used. Device 401 interprets marks made using stylus 404 in 
order to manipulate data, enter text, and execute conventional computer application 
tasks such as spreadsheets, word processing programs, and the like. 

[30] Stylus 404 may be equipped with buttons or other mechanisms to augment its 
selection capabilities. In one embodiment, stylus 404 can be implemented as a simple 
rigid (or semi-rigid) stylus. Alternatively, stylus 404 may be provided in the form of a 
pencil or pen may include one end that constitutes a writing portion, and another end 
that constitutes an eraser end which, when moved across the display, indicates that 
portions of the display are to be erased. Other types of input devices such as a mouse, 
trackball, or the like could be used in place of, or in conjunction with, stylus 404. 
Additionally, a user's own finger could be used to select or indicate portions of the 
displayed image on a touch-sensitive or proximity-sensitive display. Consequently, 
the term "user input device" is intended to have a broad definition and encompasses 
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many variations on well-known input devices. In alternate embodiments, inputs may 
be received using other devices, such as a mouse, track-ball, light pen, keyboard keys, 
etc. 

[31] As noted above, Fig. 5 illustrates an example document page display on which one or 
more embodiments of the present invention may be realized. The Fig. 5 display may 
appear on the display of the device shown in Fig. 4, and may be displayed on a 
digitizing display such that the user may write text and/or draw images using, for 
example, a stylus. To assist the user in aligning such handwritten text, one or more 
lines 503 may also be displayed. The Fig. 5 example shows a portion of text 505, 
some or all of which may be handwritten, and several drawing images 507 as well. 

As shown in Fig. 6, it is possible for a user to redefine the line height (or line size) for 
lines 503. Changing line height/size may be desirable, for example, if the user wishes 
to enlarge or reduce displayed text and/or images, and retain the lines 503 for 
additional editing. The line height, or distance between lines 503, in the Fig. 6 
example display is twice as large as that shown in Fig. 5, and consequently, the text 
505 is also enlarged. The drawings 507 are also shown to be enlarged, and partially 
displayed at the bottom of the area 501. The unique and novel manner in which the 
drawings 507 are resized and/or repositioned responsive to a change in line height is 
described below. 

[33] Various aspects discussed below refer to regions of a document, and some 
background information regarding these regions and drawings may be helpful. The 
resizing and/or repositioning of the drawings refer to horizontally-adjacent regions in 
the electronic document, although the same teachings are applicable to vertically- 
adjacent regions. These regions are simply a logical construct used to handle the 
document, and may be identified by dividing the width of the document into a number 
of sections. Figure 7 shows an example of such a logical division. In Fig. 7, logical 
divisions 701 and 703 divide the document into three horizontally-adjacent regions 
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705, 707 and 709. Although three regions are used in the Fig. 7 embodiment, any 
number of regions may be used without departing from the scope of the present 
disclosure, with a greater number of regions providing a greater degree of refinement 
in resizing/repositioning, but increasing the amount of required processing. In the 
Fig. 7 example, the three regions correspond to the left margin (region 705), the body 
(region 707) and the right margin (region 709). 

[34] The various logical regions may be used to handle the horizontal placement and/or 
resizing of various drawings. Each region may be provided with a reference axis that 
may serve as a point of reference for drawings appearing in each particular region. 
For example, the regions 705, 707, 709 are shown in Fig. 8 to have reference axes 
801, 803, 805 that are vertically arranged in the center of each respective region. The 
reference axes 801, 803, 805 provide a point of reference that may be used to identify 
locations of drawings within each region by indicating a drawing's horizontal offset 
from the reference axis for the region in which the drawing is located. For example, a 
drawing located in the body (region 707) of a document might be identified as being 
horizontally located 200 pixels to the left of the reference axis 805 in region 707. 

[35] Although the Fig. 8 reference axes 801, 803, 805 are shown as being in the horizontal 
center of their respective regions, other points of reference may be used. For 
example, the various regions 705, 707, 709 may simply have a reference axis at the 
left-most position within each region. In such an alternate embodiment, the horizontal 
offset for a drawing may simply be the distance (for example, in any form of linear 
measurement, such as pixels, inches, centimeters, etc.) between the drawing and the 
axis for the region in which the drawing is said to exist. Alternatively, the reference 
axis may be the rightmost position of each region. As another example, a single 
reference point may be defined for the regions, such as the lower-left corner of the 
region on a page, with the offset being X- and Y-coordinate distances from this point. 
Any point or axis of reference may be used, provided it sufficiently identifies a 
positional location of the drawing. 
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[36] Although horizontally-adjacent regions are discussed above, various aspects of the 
present invention may also be applied using vertically-adjacent regions of the 
document. Use of vertically-adjacent regions may be beneficial where, for example, 
vertical lines are used within the language (such as the Chinese language). In such 
languages, resizing a line width may (or column width) be equivalent to resizing a 
line height in English-speaking systems, and the rescaling and/or repositioning of 
drawings responsive to a change in line width may be performed using the same 
approach discussed herein. 

[37] When measuring or referencing the position of a drawing, or measuring a distance 
from the drawing to a reference axis, it is beneficial to define a point of reference, or 
"anchor point," of the drawing. For example, Fig. 9 shows a drawing 901 that might 
appear in a document. To precisely measure its location, anchor point 903 may be 
used to represent a location of the drawing, and to make the necessary measurements. 
The anchor point may be the center 903 of the drawing, a corner 905 of the drawing, a 
rightmost or leftmost edge of a drawing, or any other known reference point of the 
drawing used to represent a location of the drawing. In some embodiments, a 
drawing's horizontal offset value may be a distance between the drawing's anchor 
point and a reference axis of a region in the document, and the drawing may be 
considered to be "anchored" to that particular document region. Data representing a 
drawing may be based on the drawing's anchor point, such that the drawing may be 
created and displayed once the anchor point is known. For example, the data 
representing a drawing may be a series of coordinates and/or vectors relative to the 
anchor point (which may serve as the origin for the coordinates or vectors). 

[38] Because drawings are typically larger than a single pixel, they may in fact appear 
across more than one region in a document. There are many ways to determine the 
region in which such a drawing is "anchored." In some situations, a drawing may be 
anchored in whatever region contains the horizontal midpoint of the drawing. This 
may be determined by simply identifying the leftmost and rightmost points in the 
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drawing, and picking the point in between. In other situations, a weighted approach 
may be used to assign the drawing to a region. For example, the drawing might be 
anchored in whatever region contains the largest portion of the drawing. Since the 
drawing's horizontal offset values may be measured between the drawing's anchor 
point and the region's reference axis (or point), a wide variety of methods may be 
used to assign a drawing to a particular region. Whichever approach is used, the 
present invention may "anchor" drawings to a particular document region by 
identifying and/or storing the horizontal offset values between the drawing (or its 
reference point) and the region's reference axis (or point). 

[39] With this background, the process shown in Fig. 10 will now be discussed. In the 
process, which begins at step 1001, one or more drawings may be resized and/or 
relocated responsive to a change in line height or font size in the text portion of a 
document. After starting, the process may move to step 1003, in which the drawings 
are resized in proportion to the change in line height. The proportion may be a one- 
to-one proportion, meaning, for example, that a doubling in the line height will cause 
a doubling of the height and width of the drawing. Alternatively, the proportion 
might not be a one-to-one proportion, and may be adjusted as desired. For example, 
the drawings may be adjusted to a lesser degree (e.g., a doubling of the line height 
results in a less-than-doubled drawing height and/or width), while other embodiments 
may adjust drawings to a greater degree (e.g., doubling the line height more than 
doubles the drawing height and/or width). The area of a drawing may be adjusted in 
proportion to the change in line height. For example, a doubling in line height may 
simply result in a doubling of the area of the drawing. Again, the precise proportion 
will depend on the particular implementation desired, and may be defined by the user. 
Alternatively, the proportion may be dynamically adjusted such that a drawing may 
be enlarged until its width (or height) is at a maximum allowable amount (such as a 
predefined page width or height), with no more resizing beyond that point 
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[40] In step 1005, the horizontal offset values may also be rescaled according to the 
change in line height. As with step 1003, this rescaling of the horizontal offset value 
may also be proportional, such as a one-to-one proportion. However, the rescaling of 
the offset value need not be in one-to-one proportion, and can vary as desired. As an 
example, a drawing that was previously located 300 pixels to the right of a particular 
reference axis might have its horizontal offset value adjusted so that it is 600 pixels to 
the right of the axis, if the line height was doubled. 

[41] In step 1007, the rescaled drawings are repositioned according to the rescaled 
horizontal offset values. For example, in some situations, if a drawing's horizontal 
offset value were changed from 300 pixels to 600 pixels, the rescaled drawing may be 
repositioned such that the drawing's anchor point is now located 600 pixels away 
from the reference axis, as opposed to the previous offset of 300 pixels. Then, in step 
1009, a check is made to determine whether two or more repositioned drawings now 
overlap one another. This check may be made, for example, by comparing the x- and 
y- coordinates of the respective drawing regions to determine if any portion of the 
drawings occupy the same point or pixel. Overlap may also be determined for square 
or rectangular drawing regions using a comparison of maximum and minimum x- and 
y- coordinates. 

[42] If two or more drawings do overlap, the process may move to step 1011. In step 
1011, the overlapping drawings may be returned to their original sizes, and 
subsequently rescaled as a single drawing until a maximum width, such as a page 
width, is reached. By rescaling as a single drawing, the overlapping drawings, and the 
horizontal space between, may be proportionally rescaled as described above. The 
drawings may also be rescaled vertically in the same proportion, to preserve their 
aspect ratio. This process of resolving overlaps also preserves the relative distances 
between the drawings, giving meaning to the horizontal space between the drawings. 
If, however, horizontal space between drawings can be fairly ignored, then step 1011 
may resolve the overlap by rescaling the drawings to reduce their size until the 
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overlap no longer exists, or a predefined distance (such as 1, 10, 100, etc. pixels) of 
space exists between the drawings. 

[43] Once the overlap is resolved, or if no overlap existed in step 1009, a check may be 
made in step 1013 to determine whether the newly-arranged drawings would still fit 
within the allowed page width. This allowed page width may be the full width of the 
document page, or some other predefined width, such as between margins. If the 
repositioned drawings do not fit within the allowed width, then in step 1015, the 
repositioned drawings are all equally reduced in size until they do fit. If, in step 1013, 
the repositioned drawings already fit in the allowed width, then the process ends in 
step 1017. 

[44] The discussion herein refers to various rescaling and repositioning of drawings. It 
will be understood that such functions do not require that the rescaled and/or 
repositioned drawings be displayed onscreen. In the discussion of Fig. 10, the newly 
rescaled and/or repositioned drawings need not be displayed onscreen until the Fig. 10 
process is complete. The intermediate rescaled and/or repositioned drawings may 
simply be processed logically by the computing device. Additionally, the various 
drawings may be retained in memory in a variety of formats (e.g., as scalar and/or 
vector data, linked lists, trees, or any other data structure), which may dictate or affect 
how the processes described herein are carried out. 

[45] Figure 11a illustrates an example process for the addition of drawings to a document. 
At the start in step 1 101, it is determined that a new drawing is being added to the 
document, and the new drawing is displayed in the document. In step 1103, a 
bounding box is identified for the drawing to be added. This bounding box may 
represent an area occupied by the drawing, and may include more area than the actual 
drawing itself. For example, the bounding box may be the box defined by the 
minimum X- and Y-coordinates, and the maximum X- and Y-coordinates, of any 



- 12- 



Patent Application 



Atty. Docket No.: 03797.00135 



point in the drawing. Figure 1 lb shows an example of a newly-added drawing 1151 
with its bounding box 1 153. 

[46] In step 1105, the bounding box 1153 for the newly-added drawing 1151 is compared 
with existing bounding boxes 1 163 for existing drawings 1 161 to determine if overlap 
exists. This may be determined by checking to see if any points or pixels in one 
drawing's bounding box are also within another drawing's bounding box. For 
example, if bounding boxes are represented as X and Y coordinates, the comparison 
of two drawing bounding boxes (A and B) may use the following comparison; 

FOR any point in bounding box A, 

IF X coordinate is between drawing B's maximum and 
minimum X values, AND Y coordinate is between drawing B's 
maximum and minimum Y values, 

THEN overlap exists. 

[47] If overlap does exist, as shown in Fig. 1 lc, the newly-added drawing is simply added, 
in step 1107, as part of the existing drawing 1161, resulting in an expanded drawing 
and expanded bounding box 1 165, as shown in Fig. 1 Id. Adding the new drawing to 
the existing one may simply be a matter of defining a new bounding box containing 
both drawings, and adjusting the data for the new drawing to use the existing 
drawing's anchor point. For example, a new bounding box representing the combined 
drawings may be defined by determining the maximum and minimum X and Y 
coordinates for any point in existing drawing 1161 or new drawing 1151. The data 
for the new drawing, which may have previously used its own anchor point, may then 
be recalculated to reference the existing drawing's anchor point instead. As one 
example, this may be accomplished by first comparing the relative orientation 
between the two drawings' anchor points. If new drawing A's anchor point is 100 
pixels to the right of, and 200 pixels above, existing drawing B's anchor point, then 
the data for the various points in new drawing A may be adjusted to reflect a new 
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anchor point that is 100 pixels to the left of, and 200 pixels below, its previous anchor 
point. After expanding the bounding box region, the process may move to step 1111. 

[48] If, in step 1 105, no overlap existed, then the process may move to step 1 109, in which 
the newly-added drawing 1151 is classified as a separate drawing, distinct from 
existing drawings. 

[49] Then, in step 1 1 1 1, the anchor point of the expanded drawing (if overlap existed) or 
the newly-added drawing (if no overlap existed) may be revised. As discussed above, 
an anchor point may be made simply by calculating the center of the drawing. If a 
new drawing was added to an existing one, the center may now be different. 
Alternatively, and as described above, the determination of the anchor point may be 
made using a weighted approach, to find the "center of mass" for the new (or newly- 
expanded) drawing. This may be accomplished, for example, by totaling, for each X- 
coordinate in the drawing, the number of pixels in the drawing that have that X- 
coordinate. When this is accomplished for each X-coordinate, it may then be possible 
to find the weighted midpoint X-coordinate by finding the X-coordinate in which the 
difference between the number of pixels having a lesser X-coordinate (e.g., to its left) 
and the number of pixels having a greater X-coordinate (e.g., to its right) is minimized 
(or zero, if possible). It will be understood that other approaches to calculating such a 
"center of mass" may also be used. Similar steps may be used to calculate the vertical 
center as well. 

[50] Once the new anchor point is determined, the process may then determine, in step 
1113, to which region in the document (e.g., regions 705, 707, 709 in Fig. 7) the 
drawing should be anchored. Again, and as described above, this determination may 
be made by simply determining which region contains the horizontal midpoint 
determined in step 1111. Alternatively, this determination may be made by 
determining which region's reference axis is closest to the drawing's anchor point, 
and selecting that region for anchoring the drawing. 
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[51] Once the appropriate region is identified, then the system simply records the 
necessary information to indicate that the particular drawing is now anchored to the 
identified region, and an offset value is calculated. This offset value, as discussed 
above, may be the distance between the drawing's horizontal midpoint and the 
reference axis for the identified region, and may be used for future rescaling. 

[52] A record may be retained in memory of the various horizontal offsets and scaling 
information, for each drawing, that were used with previous line heights. With this 
information, if the line height were returned to a previously-used line height, the 
drawings may be returned to their original size and position, rather than undergoing 
the resizing/reposition steps discussed above. In this manner, processing may be 
reduced if a user were to change his or her mind regarding a line height adjustment, or 
if the user no longer needs the modified line height. Of course, this may be presented 
to the user as an option upon returning the line height to a previously-used value. For 
example, the user may be prompted upon returning to the line height to request 
whether previously-used scale and offset values should be restored. 

[53] With the repositioning of text and drawings due to the change in line height, drawings 
may often be forced to shift such that they no longer fit on the current page. Fig. 12 
illustrates two pages 1201, 1203 over which a drawing 1205 is spread. In some 
situations, it is preferable to display the portion of drawing 1205 on page 1201, as 
opposed to moving the entire drawing 1205 to the next page 1203, to provide clear 
feedback to the user regarding what space is available on page 1201. If, for example, 
drawing 1205 were simply moved to the next page 1203, the user might mistakenly 
believe that additional space were available at the end of page 1201. Further 
additional feedback may be provided to the user in the form of directional arrows 
1207, which indicate that the drawing continues on the next or previous page. 

[54] Although various embodiments are illustrated above, it will be understood that the 
embodiments include various aspects and features that may be rearranged in 
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combinations and subcombinations of features disclosed. The scope of this invention 
encompasses all of these variations, as defined by the claims that follow. 
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